Evaluating Machine Translations Using mNCD
نویسندگان
چکیده
This paper introduces mNCD, a method for automatic evaluation of machine translations. The measure is based on normalized compression distance (NCD), a general information theoretic measure of string similarity, and flexible word matching provided by stemming and synonyms. The mNCD measure outperforms NCD in system-level correlation to human judgments in English.
منابع مشابه
Normalized Compression Distance Based Measures for MetricsMATR 2010
We present the MT-NCD and MT-mNCD machine translation evaluation metrics as submission to the machine translation evaluation shared task (MetricsMATR 2010). The metrics are based on normalized compression distance (NCD), a general information theoretic measure of string similarity, and evaluated against human judgments from the WMT08 shared task. The experiments show that 1) our metric improves...
متن کاملThe Correlation of Machine Translation Evaluation Metrics with Human Judgement on Persian Language
Machine Translation Evaluation Metrics (MTEMs) are the central core of Machine Translation (MT) engines as they are developed based on frequent evaluation. Although MTEMs are widespread today, their validity and quality for many languages is still under question. The aim of this research study was to examine the validity and assess the quality of MTEMs from Lexical Similarity set on machine tra...
متن کاملNeuropsychiatric Symptoms in Patients with the Main Etiological Types of Mild Neurocognitive Disorders: A Hospital-Based Case–Control Study
BACKGROUND The diagnostic construct of mild neurocognitive disorders (MNCDs) is substantially congruent with previously proposed criteria for mild cognitive impairment (MCI). MNCD/MCI is associated with neuropsychiatric symptoms (NPS). Previous studies have examined the prevalence of NPS in amnestic and non-amnestic MCI subtypes; however, no studies exist for etiological types of MNCD. We aimed...
متن کاملEvaluating Statistical Machine Translation from English to Dutch
In this paper, I attempt to evaluate the effectiveness of using statistical machine translation to translate an English text into Dutch, using empirical evaluation and the Bleu evaluation metric. I also give a brief overview of the theory behind statistical machine translation and automated translation evaluation metrics. I have translated a sample of the English proceedings of the European Par...
متن کاملA Machine Learning Approach to the Automatic Evaluation of Machine Translation
We present a machine learning approach to evaluating the wellformedness of output of a machine translation system, using classifiers that learn to distinguish human reference translations from machine translations. This approach can be used to evaluate an MT system, tracking improvements over time; to aid in the kind of failure analysis that can help guide system development; and to select amon...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010